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Increasing the efficiency of engines is a long-standing technological problem. The sec- 
ond law of thermodynamics ensures that the efficiency of any engine must be below 
the Carnot bound. The idealized engines traditionally considered in thermodynamics 
operate using two reservoirs, a hot reservoir that provides energy and a cold reservoir 
that serves as an entropy sink. Here we consider a different but more common class of 
nonequilibrium engines with a single reservoir. By extending fundamental thermody- 
namic relations to nonequilibrium processes, we find a rigorous thermodynamic bound 
for the efficiency of single-reservoir engines which is below the Carnot efficiency. We 
show that the efficiency of these engines can be increased by using non-ergodic engines 
to perform work and illustrate these ideas using simple examples. These results suggest 
a new general strategy for designing more efficient engines. 

Introduction Heat engines are systems that convert heat or thermal energy into macroscopic work. 
Heat engines play a major role in modern technology and are crucial to our understanding of thermody- 
namics (i, 2). Examples of heat engines include conventional combustion engine such as those found in 
cars and airplanes, various light emitting devices, as well as naturally occurring engines such as molec- 
ular motors (3). A conventional heat engine consists of two heat reservoirs, a hot reservoir that serves 
as a source of energy and a cold reservoir that serves as an entropy sink. The efficiency of such engines 
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is fundamentally limited by the second law of thermodynamics providing an upper bound given by the 
efficiency of a Carnot engine operating at the same temperatures (7), 

with T c and the temperature of the cold and hot reservoirs respectively. 

Real engines often differ significantly from the idealized, two-reservoir engines considered in classi- 
cal thermodynamics. They operate with a single bath, such as the atmosphere, that serves as an entropy 
sink. Instead of a high temperature bath, energy is suddenly deposited in the system at the beginning of 
each cycle and is converted into mechanical work. The most common example of this are combustion 
engines such as those found in cars where energy is deposit in the system through the combustion of a 
fuel. Currently, the most realistic models describing combustion engines are based on the Otto cycle (i), 
with a corresponding efficiency, which is less than r\ c with appropriately chosen temperatures T c and T^. 
One can ask some natural questions: is the Carnot efficiency a good bound for the efficiencies of such 
single-reservoir engines or are these engines better described by a different bound? Are there realistic 
processes that allow you to realize these bounds? Can we overcome the thermodynamic bounds if we 
use engines which are not completely ergodic? 

To address these questions, we generalize the fundamental relations of thermodynamics to describe 
large, nonequilibrium quenches in systems coupled to a thermal bath. We use these relations to derive 
new bounds for the efficiency of nonequilibrium engines that operate with a single bath. We analyze our 
bounds in two different regimes, a local equilibrium regime where the system quickly thermalizes with 
itself (but not the bath), and a non-erdgodic regime where the thermalization times are much longer than 
time scales on which work is performed. We demonstrate our results using a simple examples such as an 
ideal gas that drives a piston and a magnetic gas engine. 
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Generalized Thermodynamic Identities Most applications of thermodynamics are connected to the 
fundamental thermodynamic relation (4) 

dE = TdS - Fd\ (2) 

where E is the energy if the system, T is the temperature, S is the entropy, A is some external macro- 
scopic parameter, and T is the generalized force. When A is the volume F stands for the pressure and 
the fundamental relation takes the most familiar form dE = TdS — PdV. The fundamental relation 
mathematically encodes the fact that the energy of a system in equilibrium is a unique function of the 
entropy and external parameters. For quasistatic processes, one can associate the first term with the 
supplied heat and the second term with the work done on the system by changing the coupling A. The 
fundamental relation can also be integrated for quasistatic processes and one can explicitly compute the 
total work, heat etc. However, how to generalize these calculations to strongly nonequilibrium processes 
where changes in energy, entropy, etc. can be large, is still largely an open question. Using the second 
law of thermodynamics, one can prove various inequalities. In particular, if we prepare a system A in a 
thermal state with temperature T A and let it equilibrate with a bath at temperature T then the second law 
of thermodynamics implies two related inequalties: (see Appendix lAl) 

T A AS A - AE A < 0, TAS A - AE A > 0. (3) 

The first inequality is applicable to the case where an energy AE A is deposited in the system in a 
nonequilibrium fashion, for example, by an external energy pulse, and the second inequality describes 
the relaxation of a system back to equilibrium. It implies that the free energy of the system can only go 
down during the relaxation (4). 

In this work we establish two main closely related results, which refine the inequalities ((3]) to arbi- 
trary non- equilibrium protocols using the concept of relative entropy . Relative entropy, or the Kullback- 
Leibler Divergence, is well known in information theory (5, 6) and appears naturally in statistical me- 
chanics within the context of large deviation theory (7). In deriving our results, we will use "quantum" 
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notations and restrict ourselves to discrete probability distributions. Our results also equally apply to 
classical systems with continuous probability distributions and can be derived from the corresponding 
"quantum" results by multiplying all distributions by an appropriately chosen density of states (see (8) 
and Appendix |Cl). These general results valid for both quantum and classical systems are closely related 
to those recently obtained by S. Deffner and E. Lutz (9, 10) for quantum systems but deviate in a subtle 
but important way that is crucial to our discussion (see Sec |A] for details). Consider a system A with 
external parameter A = A^ and a A-dependent energy spectrum £n^ = <?n(Ai) which is coupled to 
a thermal bath at temperature T. We assume that the bath is insensitive to the coupling A (Figure 1). 
Initially, the system is prepared in equilibrium with the bath and is described by a Boltzmann distribu- 
tion of the form pffl = exp[— 8^ /T]/Z\ with Z\ = ^ n e~ /3e ™ ) . In stage /, the system undergoes 
an arbitrary process where A is changed from A^ to , resulting in a new non-equilibrium state, q n 
(see Appendix lAl for discussion about the meaning of q n ). We do not assume that during this process 
the system is thermally isolated. During process II, the system re-equilibrates with the bath, eventually 
reaching a new Boltzmann distribution with A = \( 2 \p„^ = exp[—£n^/T]/Z2. 

During stage /, the total change in energy in the system AE 1 can be divided into two parts, adiabatic 
work, W* d , and heat, Q 1 , 

AE 1 = Wi d + Q 1 . (4) 

Adiabatic work is defined as the change in energy that would result from adiabatically changing the pa- 
rameters from A^ 1 ) to A^ 2 ). Physically, it measures changes in total energy stemming form the parameter 
dependence of the energy spectrum (potential energy). By definition, the heat is the remaining contribu- 
tion to the change in energy (2). Thus in our language heat includes both the non-adiabatic part of the 
work and the conventional thermodynamic heat. The heat generated during process / can be explicitly 
calculated (see Appendix lAl: 

Q 1 = TAS 1 + TS r (q\\pW) - TS r (p^\\p^), AS 1 = S(q) - S(p^) (5) 
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Figure 1 : Generalized nonequilibrium quenches. A system parameterized by A is coupled to an external 
bath at temperature T. Initially, A = A^ 1 ) and the system is in equilibrium and is described by the 
Boltzmann distribution p„ . I, energy is suddenly injected into the system while changing A from 
A^ 1 ) to A^ 2 ). The system is now described by possibly nonthermal distribution, q n . During stage II of 
the process, the system relaxes and equilibrates with the external bath after which it is described by a 
Boltzmann distribution pn with A = A^ 2 ). 

where the S(p) = — 2~2 n Pn logPn is the diagonal entropy of a probability distribution p (11) and 
S r (q\\p) = q n \og(q n /p n ) is the relative entropy between the distributions q and p. We have shown 
previously that for large ergodic systems, the diagonal entropy is equivalent to the usual thermodynamic 
entropy (11). Note that for a cyclic process where A^ 1 ) = A^ 2 ) the last term in Eq. © vanishes since 
pW = p(2)_ During process II, the system re-equilibrates with the bath by exchanging heat, Q 11 , with 
the reservoir. 

One can show that (see Appendix lAl 

Q H =TAS H -TS r (q\\pW), AS 11 = S(pV>) - S(q). (6) 

The importance of relative entropy for describing relaxation of nonequilibrium distributions has been 
discussed in previous for different setups both in quantum and classical systems (10, 12-15). Taken 
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together, ©, (O, and © constitute the nonequilibrium identities that will be exploited next to calculate 
bounds for the efficiency of engines that operate with a single heat bath. 
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Figure 2: Comparison of Carnot engines and single-heat bath engines (A) Carnot engines function by 
using two heat reservoirs, a hot reservoir that serves as a source of energy and a cold reservoir that 
serves as an entropy sink. (B) In the thermalization regime, energy is injected into the engine. The 
gas within the engine quickly equilibrates with itself. The gas then performs mechanical work and then 
relaxes to back to its initial state. (C). In the nonequilibrium regime, the system thermalizes on time 
scales much slower than time scales on which work is performed. (D). (blue) Maximum efficiency as 
a function of excess energy (ratio of injected energy to initial energy), r, for Carnot engine, rj c , (red) 
true thermodynamic bound, r} mt , (magenta) actual efficiency of nonequilibrium engine which acts as 
an effective one-dimensional gas, 773 (see main text), and (green) actual efficiency of three-dimensional 
ideal gas Lenoir engine, 775/3. 



Maximum Efficiency of Engines Figure 2 summarizes the single-reservoir engines analyzed in this 
work and compares them with Carnot engines (Q]). The engine is initially in equilibrium with the environ- 
ment (bath) at a temperature To and the system is described by the equilibrium probability distribution 
p e q. In the first stage, excess energy, AQ, is suddenly deposited into the system. This can be a pulse 

6 



electromagnetic wave, burst of gasoline, current discharge etc. In second stage, the engine converts the 
excess energy into work and reaches mechanical equilibrium with the bath . Finally, the system relaxes 
back to the initial equilibrium state. Of course splitting the cycle into three stages is rather schematic but 
it is convenient for the analysis of the work of the engine. Such an engine will only work if the relaxation 
time of the system and environment is slow compared to the time required to perform the work. Other- 
wise the energy will be simply dissipated to the environment and no work will be done (see discussion 
in Ref. (16)). 

The initial injection of energy, AQ results in the corresponding entropy increase AS 1 = S(q) — 
S(p eq ) of the system, where S is the diagonal entropy and q describes the system immediately after the 
addition of energy. Because by assumption the environment is not affected during this initial stage, the 
total entropy change of the system and environment is also just AS 1 . By the end of the cycle, the entropy 
of the system returns to its initial value. Thus, from the second law of thermodynamics, the increase in 
entropy of the environment must be greater than equal to AS 1 . This implies that the minimal amount 
of heat that must be dissipated into the environment during the cycle is TqAS 1 . An engine will work 
optimally if no extra entropy beyond AS 1 is produced during the system-bath relaxation since then all 
of the remaining energy injected into the system is converted to work. Thus, the maximal work that can 
be performed by the engine during a cycle is W m = AQ — TqAS 1 . For a cyclic process such as the one 
considered here, substituting © into the expression for W m implies that the maximum efficiency of a 
nonequilibrium engine, r/ nme , is given by 

W m TqAS 1 _ T S r (q\\p) 

Vmne ~ AQ ~ L AQ ~ AQ ' UJ 

Equation Q is the main result of this paper. It relates the maximum efficiency of an engine to the 
relative entropy of the intermediate nonequilibrium distribution and the equilibrium distribution. We 
next consider various limits and applications of this result. We point that Eq. (f5]) also allows us to extend 
the maximum efficiency bound to a more general class of engines, like Otto engines, where during the 
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first stage of the cycle one simultaneously changes the external parameter A from Ai to A2. In this case, 



where p^ and p^ stand for equilibrium Gibbs distributions corresponding to the couplings Ai and A2 
at the beginning and the end of the process I respectively. Since the second term is negative, changing 
the external parameter during the first stage can only reduce the engine efficiency, though this may be 
desirable for other practical reasons unrelated to thermodynamics. 

Efficiency of Thermal Engines An important special case of our bound is the limit where the the 
relaxation of particles within the engine is fast compared to the time scale on which the engine preforms 
work (see Figure 2). This is the normal situation in mechanical engines based on compressing gases and 
liquids. In this case, after the injection of energy the particles in the engine quickly thermalize and can 
be described by a gas at an effective temperature T(E) = (dS/dE)^ 1 that depends on the energy of the 
gas. It is shown in Appendix that in this case, (0 reduces to 



By definition i] mt is the true upper bound for thermal efficiency of a single reservoir engine. 

It is easy to see that r/ mt is the integrated Carnot efficiency and thus it is always smaller that the 
Carnot efficiency corresponding to the same heating Q/ t = AQ (see Fig. 2). This efficiency bound 
becomes very simple for ideal gases where T(E) oc E. Assuming that in the beginning of the cycle the 
system is in equilibrium with environment, one has that the maximal efficiency of an equilibrium engines 
that thermalizes is 



Vmne — 



To[S r (q\\pM)-S r (pW\\p( 2) )] 
AQ 



(8) 




(9) 



rj mt = l log(l + r) 



(10) 



where r = AQ/E = AT/T . For comparison the equivalent Carnot efficiency is 



T 



(11) 



Vc = 



r + 1 
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It is interesting that the result for r] m t is valid for arbitrary ideal gases and does not depend on dimension- 
ality or the type of dispersion (linear, quadratic etc.) or the number of internal degrees of freedom. It is 
also valid for mixtures of ideal gases with different masses and dispersion relations. The expression (fTOl) 
can be extended to the situations where the initial temperature of the engine is different from that of the 
environment (see Appendix ICi 

Higher efficiency bound for non-thermal distributions. Another interesting limit is when the full 
thermalization time in the system is long compared to the time required to perform the work. We call 
engines that work in these parameter regime nonequilibrium engines. This situation can be realized in 
small systems, integrable or nearly integrable systems with additional conservation laws or the systems 
where different degrees of freedom are weakly coupled like e.g. kinetic and spin degrees of freedom of 
molecules, electrons and phonons in metals and semiconductors and so on. In such systems the process 
of relaxation typically occurs in two stages. The system first undergoes a fast relaxation to a quasi 
steady-state, prethermalized distribution. Subsequently, the system then very slowly relaxes to the true 
equilibrium distribution. The notion of prethermalization mechanism was first suggested in the context 
of cosmology (77). Since it has been confirmed to occur both experimentally and theoretically in many 
physical situations including one and two dimensional turbulence (18), weakly interacting fermions (19), 
quenches in low dimensional dimensional superfluids (see Ref. (20) for review). 

Prethermalization is well known from standard thermodynamics where two or more weakly coupled 
systems first quickly relax to local equilibrium states and then slowly relax with each other. From a 
microscopic point of view, prethermalization is equivalent to dephasing with respect to a fast Hamiltonian 
Hq where the density matrix effectively becomes diagonal with respect to the eigenstates of Hq. It was 
also recently realized that thermalization can be also understood as dephasing with respect to the full 
Hamiltonian of the system through the eigenstate thermalization hypothesis (21-23). In the language of 
kinetic theory of weakly interacting particles, prethermalization implies a fast loss of coherence between 
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particles governed by the noninteracting Hamiltonian Hq 




>|/2 followed by a much slower 



relaxation of the non-equilibrium distribution function to the Boltzmann form due to small interactions. 

The efficiency of a nonequilibrium engine is given by ([7]) with q now representing the prethermalized 
distribution. A simple minimization shows that the numerator of (UJ) for a fixed energy increase AQ 
has a minimum precisely for the Gibbs distribution (see Appendix [D]). Thus, any non-equilibrium state 
can only increase the maximum possible efficiency of the engine. Alternatively this statement can be 
understood from the fact that the Gibbs distribution maximizes the entropy for a given energy (24) . 
Finally, notice that the first equality in ([7]) implies that the maximum value of r] mne is achieved for a 
process when the prethermalized non-equilibrium state has the same diagonal entropy as the initial state 
i.e where the probability q n are permutations of the probabilities p n . 

Maximum efficiency of coherent non-equilibrium engines. Finally we briefly discuss the efficiency 
bound for coherent engines which preserve coherence between particles while performing macroscopic 
work. Such engines are sensitive not only to conserved or approximately conserved quantities (like 
energy and velocity distribution for weakly interacting gas) but also to non-conserved degrees of freedom 
(like precise positions of particles at a given moment of time). In practice, such engines can be realized 
only for very small, non-interacting systems with long coherence times. Such engines have the highest 
efficiency bound still given by Eq. (UJ) but with S r standing for the full relative entropy of the non- 
equilibrium distribution q with respect to the equilibrium distribution p (see Appendix lAl for details): 



We will not further discuss such engines since they are not thermal. 

Some simple examples Let us start from the simplest ideal gas single reservoir engine which pushes 
the piston. The engine undergoes the Lenoir cycle as illustrated in Figure 2. First a pulse of energy AQ 
is deposited to the gas via e.g. a gasoline burst. The gas immediately thermalizes at a new temperature 



Sr(q\\p)=Tv[p(log(p)-log(p))]. 



(12) 
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corresponding to the energy E + AQ and a new pressure. The gas then undergoes adiabatic expansion 
pushing the piston and performing work until the pressure drops to the initial atmospheric value. The 
system then relaxes back to the initial state at a constant pressure by interacting with the environment. 
Using standard thermodynamic relations it is easy to derive the efficiency of this engine as the ratio of 
the total work performed by the piston during this cycle to AQ (see Appendix lE.il ) 



where 7 = C p /C v is the usual heat capacity ratio and r = AQ/E = AT /To is the relative energy 
(temperature) change of the gas due to the initial energy pulse. For ideal monoatomic gas 7 = 5/3. 
Clearly the efficiency r/ 7 is bounded by rj m t for the ideal gas (Eq. (fTOl)). As 7 — > 00 the efficiency 
r]j asymptotically approaches r\ mt and for 7 — > 1 (minimal possible value) the efficiency r/ 7 goes to 
zero. For a typical value r = 1 where the temperature increases by a factor of 2 during the pulse for 
monoatomic gas we find r] mt ~ 0.31 and ry 7 « 0.14, i.e. the efficiency of such engine is significantly 
below the thermodynamic bound (which in turn is considerably less than the Carnot bound 7] c = 0.5). For 
r = 2, i.e. when the temperature jumps by a factor of three the situation is somewhat better r/ m4 « 0.45 
while 7/ 7 Ri 0.22. For more complicated molecules with 7 closer to one the efficiency is even less. 

Now let us assume that the same engine is in nonequilibrium state. In particular, we assume that the 
pulse generates a fraction of very fast particles moving horizontally, which very slowly thermalize with 
the rest of the particles. In this case these particles effectively behave as a one dimensional gas with 7 = 3 
(see Appendix IE.2I ). The efficiency of this non-equilibrium engine is still below thermodynamic bound 
r\ mt because the latter does not depend on dimensionality, but it is much higher than the efficiency of the 
equilibrium engine according to our general expectations. In particular 73(1) ~ 0.22 and 73(2) ps 0.33 
i.e. we are getting approximately 50% improvement of the efficiency compared to the equilibrium gas. 
With this simple design it is impossible to exceed the thermodynamic bound 7] mt because pressure is 
only sensitive to the overall kinetic energy not to details of the energy distribution. 

It is possible exceed the thermodynamic efficiency 7] rnt by considering more complicated engines 




(13) 
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with an additional magnetic degree of freedom such as spin or electric dipole moments that couple to 
a magnetic field in the z-direction (see Appendix |F]>. We pump energy into the gas by flipping spins 
with some probability R. This can be done by a resonant laser pulse or by a Landau-Zener process 
where we adiabatically turn on a large magnetic field in x-direction then suddenly switch its sign and 
slowly decrease it back to zero. Ideally this process creates a perfectly inverse population of atoms 
compared to the initial state but in practice there will be always some imperfections. In general, the new 
occupation numbers q can be obtained from a single parameter describing the flipping rate: R E [0, 1] 
(see Appendix [0). 




0.0 0.2 0.4 0.6 0.8 1.0 



R 

Figure 3: Efficiency of magnetic engine with initial temperature equal to 10% of the Zeeman energy: 
To = 0.lh z as a function of the spin flipping rate (see Appendix |F] for details), (black) r\ mne , maximum 
nonequilbrium efficiency, (red) r) m t, maximum thermal efficiency, (pink) r] mgne , efficiency of magnetic 
gas engine in nonequilibrium regime, (green) 775/3, efficiency of thermal ideal gas engine,(blue) r] mge , 
efficiency of thermal magnetic gas engine. 

Again, we consider two regimes: the thermal regime where atoms thermalize before performing 
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work and the nonequilibrium regime where the opposite is true. We can calculate the efficiency in the 
thermal regime by calculating entropies for the magnetic gas. We extract work as before by allowing the 
gas to adiabatically expand and push a piston. The magnetic gas differs from the ideal gas because the 
entropy now has contributions from both the kinetic energy as well as the spin sector (see Appendix |F]). 
The additional spin contribution to the entropy will make the engine somewhat less efficient then the 
ideal gas engine because the additional entropy of the spins is eventually released into the environment 
as heat. However, this difference can be very small (see Figure 3). 

In the non-equilibrium regime, if R > 1/2 and there is population inversion in the spin sector, we can 
increase the efficiency of the engine beyond r} mt by allowing the spin degrees of freedom to perform work 
before they relax with kinematic degrees of freedom. This can be done by rotating the spins around the 
x axis by a angle ir and allowing the system to perform work during the rotation by exerting a torque on 
the source of the z-field (see Appendix [0). The remaining kinetic energy is then used to extract work via 
adiabatic expansion of the gas as in an ideal gas engine. An interesting special case is when the transition 
probability R = 1. In this case, the ground and excited spins exchange roles after the injection of energy 
so that rotating spins by an angle of tt returns to the system to equilibrium with no residual entropy. It 
is clear that such an engine will have 100% efficiency. Of course any deficiencies like uncertainty in the 
period of rotation or in Larmor frequencies of different atoms will lower this efficiency. However, this 
simple example demonstrates that it is theoretically possible to design thermal non-ergodic engines with 
efficiency arbitrarily close to 100% . For smaller values of R it is easy to see that after the -k rotation 
there is always excess magnetization and excess entropy compared to the initial equilibrium state thus 
the efficiency of the engine is reduced. This is summarized in Figure 3. As is evident from the figure 
rjmne given by Eq. © indeed provides a true upper bound for any engine. 

Discussion In this work, we extended the fundamental thermodynamic relation to a large class of 
nonequilibrium phenomena where energy is suddenly injected into a system coupled to a thermal bath. 
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Using these relations, we have derived new thermodynamic bounds for engines that operate with a single 
reservoir. In particular, we have shown that the efficiency can be related to the relative entropy of the 
nonequilibrium distribution immediately following the injection of energy. Our new bound has several 
striking implications. First, we find that the true thermal efficiency of single-reservoir engines is be- 
low the corresponding Carnot bound. This gives a better metric for measuring the efficiency of actually 
existing engines. Second, the efficiency of engines can be increased by using nonequilibrium (prether- 
malized) distributions. Taken together, this suggests some broad guidelines for building more efficient 
engines. 

The Carnot engine has served as a major source of intuition for increasing the efficiency of real 
engines. It is our hope that the nonequilibrium efficiency ([7]) can provide similar intuition for nonequilib- 
rium engines. Of course, the technological challenge of constructing a specific engine which can harness 
the additional efficiency possible with nonequilbrium engines remains an open question. Nonetheless, 
as illustrated with the simple examples considered here, this represents a tantalizing new possibility for 
future engine designs. 

A Derivation of Thermodynamic Identities 

In this section, we derive the nonequilibrium fundamental thermodynamic relations established in the 
main text. As shown in Figure 1 of the main text, we consider a process that proceeds in two parts: In 
part I), the system A is prepared in equilibrium and is characterized by a Gibbs distribution with tem- 
perature T and parameters A = A^ 1 ). We denote the initial distribution by ■ The system A then 
undergoes an arbitrary process, which brings it to the new possibly nonequilibrium state while simulta- 
neously changing A from A^ 1 ) to \( 2 \ Since the energy distribution only depends on the probabilities of 
occupying the eigenstates q n , which form the so called diagonal ensemble, we will be concerned only 
by these probabilities. The distribution q n can correspond to an effective thermal distribution at a higher 
temperature, or to a prethermalized, nonequilibrium distribution. For example for weakly interacting gas 
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of particles q n is described by their possibly nonequilibrium momentum distribution. In stage II) the 
system A prepared in the nonequilibrium state relaxes to a new equilibrium state with the bath B and is 
described by an equilibrium distribution pffl with A = A^ 2 ^. In principle during this relaxation one can 
still perform the work on A but for simplicity we assume this does not happen. 

We stait by denning several important concepts. The first is the diagonal entropy of a distribution, 
p n , which we label S(p). The diagonal entropy is the same as the Shannon entropy of the distribution 
and reduces to the thermodynamic entropy for large systems (11).. It is explicitly given by, 

S{p) = -^Pnlogpn. (14) 

n 

For stationary distributions the diagonal entropy is the same as the von Neumann's entropy S vn (p) = 
— Tr [plog(p)], with p the corresponding density matrix. A second related concept is the relative entropy, 
S r (q\ \p) between two distributions p and q, which is defined as 

S r (q\\p)= y> n log-. (15) 

n P» 

In general, the notion of relative entropy can be extended to full density matrices, p and p q , rather than 
diagonal parts: 

Sr( Pq \\p) = Tr [p q (log(p q ) - logfo))] (16) 

As we already mentioned in this work we will be interested in only the diagonal part of the distribution 
q and thus in the associated entropy S r and not S^ n . 

Another related concept is the adiabatic work, W a d ( see a l so a related discussion in Ref. (25)). 
Consider a system parameterized by A with a A-dependent energy spectrum, e^. Lets assume that the 
system is initially in equilibrium with a bath at temperature T described by a Boltzmann distribution 

with = J2 n e~P e<n ' the usual partition function. Now consider a process where an external param- 
eter is adiabatically changed from A = A^ to A = A^ 2 ^. Since this is done adiabatically, the probability 
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distribution p$ does not change during the process. We define the total change in energy of the system 
during such an adiabatic process the adiabatic work, W ad . It represents the minimum amount of work 
that can be done in changing parameter from A^ to X^ and is given by 

n 

After defining these concepts let us consider process /. The total energy change during this process 



is 



A^^E^-^^- (19) 

n 

Now notice that we can rewrite 

AE 1 = Wl d + J> n - pU)e^ = Wi d - Tj2(<ln ~ p£>) krf = 

n n 

+ T T,^ l °^- T T,P { n )l0 ^+ T T,P i n ) l0 § ^-rEfc q» = W J ad + S r (q\ \p^ ) 
n Pn n Pn n n 

- S r ( P ^W 2) ) + T[S(q) - TS(pW)] = W l ad + SMWP^) ~ Sr(p {1) \\p {2) ) + TAS 1 (20) 

. By definition, we have that the heat Q 1 is just 

Q 1 = AE 1 - W^ = TAS 1 + TS r (q\\pW) - TS r (p^\\p^) (21) 

This is the first of the thermodynamic entities. For a cyclic process or a standard heating process where 
the coupling X^ = A^ we have = p( 2 ) and the last term vanishes so 

Q 1 = AE 1 - Wi d = TAS 1 + TS r (q\ \p^) (22) 

Because the relative entropy is non-negative we immediately see that Q 1 — TAS 1 < 0, which is the first 
inequality in Eq. (3) of the main text. 

In process II when the system relaxes, the total change in energy is by definition the heat, Q n , 
exchanged with the reservoir. In this case, we can write 

Q" = Z)(p£° " = T J2(ln- P^ ) lo § Pn ) + T £ b S «» " T E b g *» 

n n n n 

= T5(p (2) ) - TS(q) - TS r {q\\P (2) ) = TAS 11 - TS r {q\\p {2) ) (23) 
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This yields the second thermodynamic identity, from which the second inequality in Eq. (3) of the main 
text immediately follows. This result implies that the relative entropy between the arbitrary nonequilib- 
rium and equilibrium distributions has a physical meaning of the total entropy generation in the system 
+ bath during the relaxation of the nonequilibrium distribution to equilibrium. Indeed by energy con- 
servation the heat dissipated to the bath is Qb = —Q n - Because the temperature of the bath does not 
change we can use the standard thermodynamic identity Qb = TASb- Combining this with Eq. (l23l) 
and changing the notation AS 11 — > AS a we indeed find that 



As expected in accord with the second law of thermodynamics the total entropy change in the system 



Let us finally point that the relations (|2TT) and (l23l) are also valid if we use the von Neumann's 
entropy (in contrast to the Diagonal entropy) to define AS 1 ' 11 and the corresponding von Neumann's 
relative entropies given by Eq. ( fT6l ). In this form the similar relations were obtained earlier in Ref. (10), 
see also Ref. (13) for similar results in classical systems. 

B Thermodynamic Entities for classical/large systems 

In this section, we discuss the relationship between the"quantum" notation used in the paper and the 
classical thermodynamic quantities that usually depend only on energies. For macroscopic systems, we 
can replace a probability to be in a state p n by the probability, W P (E), that the system has energy E by 
multiplying by an appropriate density of states, Q(E) (see (8)). We make the usual identifications 



S r (q\\pM) = AS a + ASb 



(24) 



and the bath is always non-negative as S r (q\\p ( - 2 ' ) ) > for arbitrary q. 



W P (E) = p(E)Q(E) 



(25) 



and replace sums by integrals 




n 



(26) 
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This identification allows us to translate all expression in the text to usual thermodynamic expres- 
sions. As an illustration consider the diagonal entropy, 

S = -^2p n logp n . (27) 

n 

Under the identification above this becomes 

S = - J dEWp(E) log W P (E) + J dEWp(E) log Q(E). (28) 

For macroscopic systems, we know that the density of states are well approximated by a Gaussian (see 
(*)) 

-(E-Ef/28E 2 

W >W = — asp— C2» 

Therefore, we can calculate the entropy and one finds 

S(E) = log y/2neSE + J dEW p (E) log Q(E) (30) 
m log(V2TreSEn(E)) (31) 

As discussed in section II.D of (11) this is precisely the thermodynamic entropy. 

C Maximum Efficiency of Thermal Engines 
C.l General Thermodynamic Considerations 

We will start our analysis from the most straightforward setup where the system is macroscopic and the 
relaxation time within the system is the fastest time scale in the problem. This is the natural situation in 
gases, liquids and solids where the relaxation times are extremely fast. In this situation the initial energy 
increase AQ 1 results in the corresponding entropy increase AS 1 = S(E + AQ) - S{E). Because 
by assumption the bath is not affected during this initial stage, this entropy increase equals to the total 
entropy change of the system and environment. For remainder of the engine's cycle, the total entropy 
change of the system and environment must be non-negative due to the second law of thermodynamics. 
By the end of the cycle, the entropy of the system returns to its initial value. Consequently, the entropy 
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of the environment must increase by an amount AS 1 or larger. Thus, the minimal heat dissipated to 
the environment during the cycle is TqAS 1 where To is the temperature of the environment. Thus the 
maximum amount of work that can be performed during the cycle is W max = AQ 1 — TqAS 1 . Hence, 
the maximum thermodynamic efficiency of our engine is 



where T{E) = dE/dS is the equilibrium temperature of the system. We emphasize that deriving this 
result we never assumed that the initial energy change in the system is quasi-static. We have only used the 
fact that the equilibrium entropy is a unique function of energy. The result d32~l ) is very general since it is 
obtained with the single assumption of fast equilibration within the system. This assumption is justified 
for most practical heat engines like combustion engines. As discussed in the main text, this efficiency 
bound becomes very simple for ideal gases where T{E) oc E. Assuming that in the beginning of the 
cycle the system is in equilibrium with environment: T(E) = Tq 



where r = AQ 1 /E = AT/T . 

C.2 Initial temperature of engine not equal to environment 

The result (l32l still applies if in the beginning of the cycle the system is at some temperature T, = T(E), 
which is not the same as the temperature of the environment. This setup is e.g. realized in Otto engines, 
which are closest prototypes of real combustion engines. From the conceptual point of view this can 
happen if the engine does not have time to fully relax to equilibrium with the environment during one 
cycle. It is easy to see that in the limit when (T(E + AQ 1 ) — Tj <C To, i.e. when the excess impulse 
AQ does not substantially change the temperature of the engine, the maximum efficiency is given by 
the Carnot limit. Practically, this situation is probably not advantageous since an engine which is hot 
most of the time will constantly radiate heat to the atmosphere. 




(32) 



%it = 1 - 



- log(l + r) 



(33) 
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For ideal gases with Tj ^ Tq (1321) generalizes to 



r/ m4 = l-^log(l + r),, (34) 
r 



where r, = To/Tj. When Tj = 1 Eq. (l34l obviously reduces to Eq. (l33l . 
C.3 Explicit derivation from general expression 

In this section, we re-derive these results starting with the general expression 

TS r {g\\p eq ) 

V = AQ ■ (35) 

Rather than repeating and expanding the "quantum" derivation given in the main text we will work 
here directly with continuous distributions to give the reader a feel of how these results can be derived 
directly from classical statistical physics. In this derivation we will make no assumptions about the form 
distribution q and assume that the equilibrium distribution p(E) obeys the Bolztmann's form: 

p(E) = ^e W [-PE], (36) 

where Z is the continuous partition function. 

The key assumption in our derivation is that after the initial pulse of energy the engine reaches a 
stationary state with respect to the fast Hamiltonian Hq, i.e. the relaxation with respect to Ho is the 
fastest time scale in the problem. If Hq is interacting and the system is large then such relaxation is 
equivalent to the thermalization in the engine at some higher temperature. But if Hq is noninteracting or 
the engine is very small, consisting of very few degrees of freedom then such relaxation leads to some 
stationary nonequilibrium state. For integrable systems such state can be well described by a generalized 
Gibbs ensemble (26). For a single particle in a chaotic cavity such relaxation means loss of memory 
about the position and direction of the momentum for a particle moving along a periodic orbit in a 
regular cavity the relaxation implies loss of memory of the coordinate along the trajectory (see Ref. (8) 
for additional discussion). The important mathematical result proven in Ref. (11) is that if two systems 
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are prepared in stationary states and then coupled in an arbitrary way the sum of their diagonal entropies 
can only increase or stay the same. Thus 



AS 11 + A 5b > 0. 



(37) 



In the same work (see also Appendix |B]) it was also proven that for large systems like the bath the diag- 
onal entropy reduces to usual thermodynamic entropy and that it obeys the fundamental thermodynamic 
relation: TASb = Qb- From the energy conservation we have Qb = —Q H thus we find 



Q n < TAS 11 . 



(38) 



So the minimal amount of heat dissipated to the bath is equal to the difference between the diagonal 
entropies of the system in the nonequilibrium state q and the equilibrium state. Therefore the maximum 
efficiency of any engine, equilibrium or nonequilibrium, is given by 



rj m = max 



Q 1 + Q 



ill 



Q 1 



Q 1 + TA S 



ii 



(39) 



Now let us evaluate these terms explicitly 



Q 1 = J dEQ{E)E(q(E) - p(E)) = 

dE E(W q (E) - W P (E)) =T J dE(W p (E) - W q (E)) \og{p(E)). (40) 



where W q (E) = Q(E)q(E) is the nonequilibrium energy distribution after the initial energy pulse. 
Similarly (see Ref. (11)) 



TAS 11 = T j dE[W q (E)\og{q{E)) - W P (E) log(p(E))] 



(41) 



Thus we find 



Q 1 + TAS 11 = T J dE W q {E) log 
This completes the proof of Eq. 05l ). 



p(E) 



dEW q (E) log 



W q {E) 
W P (E) 



S r (q\\p). (42) 



21 



C.4 A Brief Digression on Coherent Engines 

We can also generalize the result to "coherent" engines where the quantum coherence between particles 
is maintained. As we explained in the main text such engines either work on time scales faster than 
relaxation even with respect to the fast Hamiltonian Hq or which preserve coherence during evolution, 
e.g. where all particles perform a collective oscillatory motion. For this class of engines the proof above 
stands if we use the von Neumann's entropy instead of diagonal entropy for the system in Eq. (|37T ) and 
Eq. OH) as well as the full relative entropy S^ n (p g \\p) (see Eq. £l6]>) instead of S r (q\ \p) in Eq. (|42l . The 
proof relies on subbativity of the von Neumann's entropy (27), which for the system and the bath states 
S v / B {t) < S v /{t) + S v B n (t). Using that S v B n {t) < S B (t) (11) and 5^(0) = S v /{0) + S B {0) as well as 
the relation TAS B = AQ B we prove Eq. (@2]> with S r (q\\p) -> S^ n (p q \\p). It is easy to check that the 
relative entropy can only increase if the matrix q becomes off-diagonal so as expected the engines which 
preserve coherence during work cycle can be more efficient than engines which loose coherence due to 
dephasing. 

D Increased Efficiency from Non-thermal distribution 

The physical reason for inevitable losses in engines is the second law of thermodynamics which states 
that the total entropy of the system and bath can only increase or stay the same. In the class of engines 
we consider, the entropy is generated during the initial pulse of energy and its dissipation to the bath 
leads to heating losses. Thus, it is intuitively clear that a engine can be made more efficient if the the 
entropy added to the system during the initial energy pulse is minimal. Because the equilibrium Gibbs 
distribution maximizes entropy for a given energy, it is clear that the nonequilibrium engines with smaller 
entropy have the potential to more efficient than equilibrium engines. Here we mathematically prove that 
this is indeed the case using the general result (I35T ). In particular, below we prove that for a given energy 
change AQ the relative entropy between q and p distributions is minimal when q(E) is described by the 
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Gibbs form. The minimum of the relative entropy can be found by extremizing the expression: 

^2 1n[log(q n ) - log(pn)] + ol\ ^2 E n {q n - Pn) + a 2 ^ q n (43) 

n n n 

with respect to the set of q n , where a\ and a 2 are the Lagrange multipliers enforcing the fixed energy 
and the probability conservation. Differentiating the result above with respect to a particular q m we find 

log(g m ) + 1 - log(p m ) + a x E m - a 2 = 0, =>• q m = Cexp[-(/3 + ai)E m ]. (44) 

I.e. the distribution q, which extremizes the relative entropy with respect to the Gibbs distribution is 
another Gibbs distribution corresponding to a different temperature fixed by the energy change. The fact 
that this extremum is minimum is obvious from considering the zero energy change case. This can be 
also checked explicitly by taking the second derivatives of the relative entropy with respect to the set of 
q n - 

E Ideal Gas Engine 
E.l Equilibrium 

We now consider an ideal gas engine that functions as described in the main text realizing the Lenoir 
cycle. First a pulse of energy AQ is deposited to the gas via e.g. a gasoline burst. The gas immediately 
thermalizes at a new temperature corresponding to the energy E + AQ and a new pressure. Then the 
gas undergoes adiabatic expansion pushing the piston and performing work until the pressure drops to 
the atmospheric value and finally the system relaxes back to the initial state at a constant pressure as 
the atmosphere pushes the piston back. Practically the engines based on the Lenoir cycle are not very 
efficient due to reasons unrelated to thermodynamics. We will use this cycle for illustration of our results 
because it is conceptually the simplest single heat reservoir engine. 

The Lenoir cycle consists of three processes. Initially, the gas has pressure Pq, volume, Vq, and tem- 
perature To. Next, energy is injected at constant volume so the effective temperature and pressure must 
rise. So after energy deposition, the system is described by pressure, Pjj, volume Vo, and temperature 
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Th- The system then performs work by adiabatically expanding until the pressure equalizes. The system 
is then described by pressure, Po, a volume V*, and a temperature T*. Finally the system relaxes back to 
the initial state by dropping temperature and volume back to To and Vq. To calculate the efficiency, we 
calculate the work the system performs and dived by the total heat added: 

W 

" = Sq- <45) 

Denote the heat capacity ratio of an ideal gas by 7. It is related to the number of degrees of freedom / 
per molecule by 7 = (/ + 2)//. We can write 

AQ = f -nR(T H - T ) = -^— n R{T H - T ). (46) 
2 7 — 1 

By definition, the work is 

rV, 

W = / (P(V) - P )dV, (47) 
JVq 

To calculate the work during the adiabatic expansion, we use the fact that for an adiabatic process the 

product PV 1 is a constant. Thus, we can rewrite the equation above as 

-v* 



W = P V: [ dV±- - P (K - Vo) 



(48) 

'Vo 

(49) 

Explicitly performing the integral yields, 

w =v Y i({W' 1 - 1 )- p '' {v '- v '' ) - (50) 

We now use the relation P*Vj = PhVq and the ideal gas law to find V* = Vq(1 + r) 1 / 7 , where 
t = (T h - T )/T . Then 



W = P Vo 



l_((l+ T fh _i 



(51) 



7 — 1 7 — 1 

Finally rewriting Eq. (l46l ) as AQ = -^jPo^o we And the desired result shown in the main text: 

?? 7 = 1-^ ((1 + ^-1). (52) 
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As we already discussed, the efficiency r/ 7 is bounded by the maximum thermodynamic efficiency (l33l) 
as it should approaching this bound as 7 — > 00. For a monoatomic gas we have 7 = 5/3 and the 
corresponding efficiency is plotted in Fig. 2 of the main paper. 

E.2 Nonequilibrium Ideal Gas Engine 

We now consider a nonequilibrium ideal gas engine of the following form. Consider, the scenario where 
an energy pulse generates a fraction of very fast particles moving horizontally, which very slowly ther- 
malize with the rest of the particles. In this case these particles can be treated as effectively a one 
dimensional gas with 7 = 3 such that Eq. (l52l applies. Microscopically this result can be understood by 
using the conservation of the adiabatic invariants (28). Indeed, during the slow motion of the piston the 
fast particles approximately conserve adiabatic invariants equal to the product of the momentum, p, and 
twice the distance between piston and the wall, which we denote V (since in our setup the area of the 
piston does not change the length and the volume aree equivalent). This implies 

pV = d, (53) 

with C\ a constant. Thus, we expect that 

p oc V~ l (54) 

Furthermore, consider the pressure, P, of such a gas can be thought of as the force per unit area or 
equivalently the energy density per unit volume, 

P oc p 2 /V (55) 

Taken, together these relations imply that 

PV 3 = const. (56) 

This is precisely the relationship for a gas adiabatically expanding with 7 = 3. Thus, the efficiency is 
equivalent to that of an adiabatic ID gas with 7 = 3. As we expect the efficiency of the nonequilibrium 
engine is higher (see Fig. 2 in the main text). 
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Interestingly rjj given by Eq. (l52l also describes the efficiency of a photon engine where the piston 
is pushed by the photon pressure created by some light source like a bulb. In this case one should 
use 7 = 4/3 in the equilibrium case, where the photon gas is equivalent to the black-body radiation 
at a higher temperature and 7 = 2 in the nonequilibrium case where the photons are effectively one- 
dimensional. Again the nonequilibrium setup allows one to increase the engine efficiency. 

F Magnetic Gas Engine 

Now we add an additional spin degree of freedom to the gas. Then as we show below one can create a 
nonequilibrium engine with efficiency higher than the thermodynamic bound and which can be arbitrary 
close to 100%. Assume that we have a gas composed of N atoms which have additional magnetic degree 
of freedom like a spin. For simplicity we assume that the spin is equal to 1/2, i.e. there are two magnetic 
states per each atom. As will be clear from the discussion, this assumption is not needed for the main 
conclusion and the calculations can easily be generalized to the case where we consider electric dipole 
moments or some other discrete or continuous internal degree of freedom instead of the spin. 
The Hamiltonian of the system is then 

2 

Tnv ■ 

j 

where crj are the Pauli matrices. To simplify notations we absorbed the Bohr magneton and the g factor 
into the magnetic field. The first term in the Hamiltonian is just the usual kinetic energy and the second 
term is due to the interaction of the spin degrees of freedom with an external field in the z-direction. 
Initially the system is in equilibrium at a temperature T and a fixed magnetic field h z . 

Now let us assume that via some external pulse we pump energy to the atoms by flipping their spins 
with some probability. This can be done by a resonant laser pulse or by e.g. a Landau-Zener process 
where we adiabatically turn on a large magnetic field in x-direction then suddenly switch its sign and 
slowly decrease it back to zero. Ideally this process creates a perfectly inverse population of atoms 
(i.e. number of spin up and spin down particles is exchanged) but in practice there will be always some 
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imperfections. In general unitary process the new occupation numbers can be obtained from a single 
parameter describing the flipping rate: R £ [0, 1], with 

q t = pt(l -R)+ Pl R, gi = Pi (l -R)+ Pt R (58) 

During such a process, the energy added to the system is 

AQ = 2Nfih z R(p^- Pi ) = 2Nfih z Rtanhf^. (59) 

As expected this energy is non-negative. As before we will discuss first the equilibrium and then a 
nonequilibrium engines 

El Equilibrium Efficiency 

In the equilibrium case the atoms are first allowed to relax to a thermal distribution corresponding to the 
new energy. This will result in a higher effective temperature Tjj for the magnetic gas. This temperature 
can be found from the equation relating temperature to energy: 

^ - Nfih z tanh ^=E + AQ, (60) 
2 1 H 

where E is the initial equilibrium energy of the system. 

Work can be extracted in a similar manner to the ideal gas engine considered above by letting the 
gas adiabatically expand and push a piston until the pressures equilibrate. We know that the work done 
during such a process is 

W= [ *(P(V) - P )dV, (61) 
JVo 

where we have adapted the notation of the last section. 

During an adiabatic expansion the entropy must be conserved. The entropy as a function of the 
volume and temperature of magnetic gas is given by 



' = C + log (V) + + log 

JM 7 — 1 
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2 cosh ^ 



fih z iih z 

— tanh—, (62) 



where C is an unimportant constant and V is the volume. Notice that the entropy has contributions from 
both the kinetic and magnetic sectors. Additionally, we know that for the gas, 

P(V,T) = NT(V)/V, (63) 

where the temperature, T(V), is now considered a function of volume during the adiabatic expansion. 
T(V) can be solved for from the self-consistency condition for adiabatic expansion 

S(T(V),V) = S(T H ,V ). (64) 

Together, these relations allow us to numerically solve for the work performed by the engine during 
adiabatic expansion and the results are shown in Figure 3. Notice, that the additional spin contribution 
to the entropy makes the engine somewhat less efficient than the ideal gas engine because the additional 
entropy is eventually released in the form of heat. However, this difference can be very small if the initial 
temperature is small compared to the Zeeman energy splitting (see Figure 3). 

E2 Nonequilibrium Effeciency 

In the nonequilibrium setup spins are allowed to do work before they relax with kinematic degrees of 
freedom. The easiest setup we can imagine is to rotate the spins around the x axis by the angle ir when 
R > 1/2, i.e. when there is an inverse spin population. This can be done by e.g. applying a strong 
magnetic field along the x-axis for exactly half the period of the Larmor precession. This extra field does 
not do any work by itself since the magnetization is orthogonal to the x-axis. We can extract a magnetic 
work W ma g from the system by coupling the magnetization of the spins to the source of the external 
z-component of the magnetic field. The amount of "magnetic" work generated from such a device is 

W mag = N\M\h z = N (2 qi -l) (65) 

The remaining excess energy can be used as in the previous part by allowing the gas to adiabatically 
expand and drive a piston. Thus, an additional work, W a d can be extracted by using the equilibrium 
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equations from the last section with AQ — > AQ — W rnag Note that for R > 1/2 we always have 
AQ > Wrnag- This allows us to calculate the efficiency for this system using the epxression 

Wmag + Wad 

V = AQ • (66) 

The resulting efficieny is plotted in Figure 3. This efficiency, as it should, is always bounded by the 
maximum nonequilibrium efficiency given by the relative spin entropy: 



_rs- r (g||p) 

Vmne ~ 



T 



(67) 



AQ AQ 
with <f|> | given by (f58|) and AQ given by ([59]) . Note that as the flip rate R approaches unity, i.e. the up 
and down spins exactly exchange, the efficiency of this engine approaches unity. This is related to the 
fact that such a pulse does not generate the additional entropy in the system and once the spins are rotated 
by half the Larmor period around x-axis performing the macroscopic work they are in equilibrium state 
with no additional relaxation required. It is easy to see that any imperfections like R < 1 or small 
disorder in spin Larmor frequencies will decrease the engine efficiency. 
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